RAG Evaluation Toolkit

GENERATOR
66.0% The Generator is the LLM inside the RAG to generate the answers.
66.0%
RETRIEVER
65.0% The Retriever fetches relevant documents from the knowledge base according to a user query.
65.0%
REWRITER
62.5% The Rewriter modifies the user query to match a predefined format or to include the context from the chat history.
62.5%
ROUTING
100.0% The Router filters the query of the user based on his intentions (intentions detection).
100.0%
KNOWLEDGE_BASE
0.0% The knowledge base is the set of documents given to the RAG to generate the answers. Its scores is computed differently from the other components: it is the difference between the maximum and minimum correctness score across all the topics of the knowledge base.
0.0%
Overall Correctness Score
66%
RECOMMENDATION
The RAG system needs significant improvements in handling "distracting" and "situational" questions since these received the lowest scores. Additionally, data enrichment or enhancing the retriever component for topics with a score of zero, like "Algae and Cyanobacteria Research", "Biomass and Biochar Studies", and several others, should be prioritized to improve the overall performance.
CORRECTNESS BY TOPIC
KNOWLEDGE BASE OVERVIEW
SELECTED METRICS
Selected metrics

Algae Biofuel Production

Algae Research

Algae Research Studies

Algae Research and Sustainability

Algae and Cyanobacteria Research

Algae and Marine Biology Research

Algae in Medical Research

Architecture and Structural Design

Biochemical Research Methods

Biomass and Biochar Studies

Biomass and Biofuel Production

Biomedical Research

Biomedical Research and Cancer Therapy

Cancer Treatment Research

Cellular Apoptosis Research

Cellular Signaling Pathways in Disease

Cellular and Molecular Biology Research

Combustion and Gasification Processes

Energy Efficiency and Sustainability

Environmental Science and Bioremediation

Experimental Bionics Workshops

Fucoidan Medical Research

Fucoidan Research Studies

Fucoidan Research and Applications

Fucoidan Research and Experiments

Fucoidan Research and Health Benefits

Fucoidan and Gut Health

Fucoidan in Cancer Treatment

Fucoidan in Marine Algae

Fucoidan in Medical Treatments

Hydrogel Material Research

Laboratory Methods and Procedures

Marine Algae Bioactive Compounds

Marine Algae Research

Marine Biology and Genetics

Marine Drug Research

Marine Fungi Research

Marine Polysaccharides Extraction and Analysis

Microalgae Biofuel Production

Microalgae Cultivation Systems

Nanotechnology and Material Science

Others

Polymeric Nanoparticles in Drug Delivery

Seaweed Polysaccharides Research

Seaweed and Algae Benefits

Sulfated Polysaccharides Research

Sustainable Waste Management

complex

distracting element

double

simple

situational